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[57] ABSTRACT 

A data compression technique includes a subband decom- 
position of a source image followed by coding of the 
coefficients of the resultant subband decomposition for 
storage and/or transmission. During coding, three ordered 
lists are used comprising a list of significant pixels (LSP), a 
list of insignificant pixels (LIP) and a list of insignificant sets 
of pixels (LIS). The pixels in the LIP are tested, and those 
that are significant at a current quantization level are moved 
to the LSP. Similarly, sets are sequentially evaluated fol- 
lowing the LIS order, and when a set is found to be 
significant it is removed from the LIS and partitioned into 
new subsets. The new subsets with more than one element 
are added back to the end of the LIS, while the single- 
coordinate sets are added to the end of the UP or to the end 
of the LSP. depending whether they are insignificant or 
significant, respectively. 

13 Claims, 9 Drawing Sheets 

TT 



12/01/2003, EAST Version: 1.4.1 



U.S. Patent 



Jun. 9, 1998 Sheet 1 of 9 



5,764,807 



7T 



77 

FIG.1 



12/01/2003, EAST Version: 1.4.1 



U.S. Patent Jun. 9, 1998 Sheet 2 of 9 



5,764 



LL3 


LH3 


LH2 


LH1 


HL3 


HH3 


HI 2 


HH2 


HL1 


HH1 



FIG. 2 



12/01/2003, EAST Version: 1.4.1 



U.S. Patent jun. 9, 1998 sheet 3 of 9 5,764,807 



7T 



* 





























\ 










\ 


f 







































7T 

FIG. 3 



12/01/2003, EAST Version: 1.4.1 



U.S. Patent Jim. 9, 1998 Sheet 4 of 9 



5,764 



NEXT 
QUANTIZATION 
LEVEL 



111 




(iNITIALIZATIONy^^ 1Q1 



SORTING 



REFINEMENT 



X 

(END 



705 



707 





113 



FIG. 4 



12/01/2003, EAST version: 1.4.1 



U.S. Patent 



Jun. 9, 1998 Sheet 5 of 9 



5,764,807 



INITIALIZATION 



rv=Llog 2 (MAX (iiJ) {|C i(j |»J 



121 



OUTPUT rv 



■123 



LSP=0 



-125 



UP=(i.j)£H -^7^/27 



US=(i,j)€H AS TYPE A 



SELECT FIRST (i.j) IN LIP 



141 



■129 



131 



139 



NEXT 

(i.j) 
IN LIP 




■133 



135 



A. 



MOVE (i.j) TO LSP 



143 



A 

FROM 

FIG. 8 




OUTPUT SIGN 
OF Ciij 



137 



TO FIG. 6 



FIG. 5 



12/01/2003, EAST Version: 1.4.1 



U.S. Patent 



Jun. 9, 1998 



Sheet 6 of 9 



5,764,807 



FROM FIG. 5 

_JL_ 



FIG. 6 



SELECT FIRST (i.j) IN LIS 



■US 




147 



OUTPUT S n (D(i,j)) 



■149 





153 



SELECT FIRST 
(k.OlN 0 (i.j) 



A 



163 

A 



SELEC 



155 



OUTPUT 



S n (M) 




(M) 



NEXT 



N 



ADD (k,0 
TO LSP 



ADD (k.OTO 
END OF LIP 



OUTPUT 
SIGN OF 
Ck,« 



FROM TO 



TO 




FIG. 7 FIG. 7 FIG. 7 



TO FIG. 7 



12/01/2003, EAST Version: 1.4.1 



U.S. Patent 



Jun. 9, 1998 



Sheet 7 of 9 



5,764,807 



TO FIG. 6 



179 



SELECT NEXT 
(i.j) IN LIS 



FROM FROM 
FIG. 6 FIG. 6 



FROM FIG. 6 
V 



v 




CHANGE (i.j) TO 
TYPE B IN LIS 




175 



OUTPUT S n (L(i,j)) 



177 




AOD EACH 
(k.O€0 O.j) 
END OF LIS 
AS TYPE A 




REMOVE 

(i.j) 
FROM LIS 



FIG. 7 



12/01/2003, EAST Version: 1.4.1 



U.S. Patent 

TO FIG. 5 



Jun. 9, 1998 



189 




SELECT NEXT 

(i.j) IN ISP AND 

NOT IN LAST 
SORTING PASS 



Sheet 8 of 9 



FROM FIG. 7 



I 



SELECT FIRST 
(i,j) IN LSP ANO 

NOT IN LAST 
SORTING PASS 



OUTPUT n th MOST 
SIGNIFICANT BIT OF 

| C i.i 



\ 


Y 


DECREMENT n BY 1 




c 



5,764,807 



187 




191 





197 



FIG. 8 




12/01/2003, EAST version: 1.4.1 



U.S. Patent jun. 9, 1998 sheet 9 of 9 5,764,807 



STORAGE 




■215 



-213 



211 



217 



MEMORY 




CPU 




!/□ 







FIG. 9 



12/01/2003, EAST Version: 1.4.1 



5,7< 

1 

DATA COMPRESSION USING SET 
PARTITIONING IN HIERARCHICAL TREES 

TECHNICAL FIELD 

The present invention relates in general to data compres- 
sion techniques. More specifically, the present invention 
relates to a data compression technique using hierarchical 
subband decomposition of a data set and set partitioning of 
data points within the hierarchical subband decomposition 
using hierarchical trees. 

BACKGROUND OF THE INVENTION 

As the amount of information processed electronically 
increases, the requirement for information storage and trans- 
mission increases as well Certain categories of digitally 
processed information involve large amounts of data which 
translates into large memory requirements for storage and 
large bandwidth requirements for transmission. 
Accordingly, such storage and/or transmission can become 
expensive in terms of system resource utilization which 
directly translates into economic expense. 

Many data compression techniques have been employed 
to decrease the amount of data required to represent certain 
digitized information. For example, compression techniques 
have been applied to the data associated with a bit-mapped 
image. One prior data compression technique devoted to 
image data is the ISO/JPEG (International Standards 
Organization/Joint Photographic Experts Group) data com- 
pression standard. Although the ISO/JPEG technique has 
been adopted as an industry standard, its performance is not 
optimal. 

Recently, techniques using hierarchical subband 
decomposition, also known as wavelet transforms, have 
emerged. These techniques achieve a hierarchical multi- 
scale representation of a source image. However, once 
subband decomposition of a source image has been 
performed, the succeeding techniques of coding the resultant 
data for transmission and/or storage have yet to be fully 
optimized. Specifically, for example, both the computational 
efficiency and coding efficiency of the prior techniques may 
be further improved. One prior technique has been disclosed 
by A. Said and W. Pearlman in "Image Compression Using 
the Spatial-Orientation Tree." IEEE Int. Symp. on Circuits 
and Systems, Vol. 1, pp. 279-282. May 1993, which is 
incorporated herein by reference in its entirety. 

Hie present invention is directed toward optimizing the 
coding of a subband decomposition of an image for trans- 
mission and/or storage. 

DISCLOSURE OF THE INVENTION 

Briefly summarized, in a first aspect, the present invention 
includes a method for use in encoding and decoding a 
subband decomposition of a data set The method comprises 
creating a list of insignificant sets of points (referred to 
herein as the list of insignificant sets — "LIS**), wherein each 
set of the LIS is designated by a root node within the 
subband decomposition and has a corresponding tree struc- 
ture of points within the subband decomposition. The tree 
structure is organized as points comprising descendants and 
offspring of the root node, wherein a first generation of the 
descendants comprises the offspring. 

The method further includes evaluating the descendants 
of the root node of each set of the LIS for significance, 
wherein a significant descendant of the descendants of the 
root node has a subband coefficient at least equal to a 



H807 

2 

predetermined threshold- For each root node of the LIS 
having at least one significant descendant, descendants of 
the offspring of the root node are evaluated for significance, 
wherein a significant descendant of the offspring of the root 

s node has a coefficient at least equal to the predetermined 
threshold. If the root node has at least one significant 
descendant of offspring, then each offspring of the root node 
is added to the LIS as a root node thereof. 
As an enhancement the method may include creating a 

io list of significant pixels ("LSP"). the LSP initially compris- 
ing an empty set and creating a list of insignificant pixels 
("UP"), the UP comprising points from within a highest 
subband of the subband decomposition. Further, for each 
root node of the LIS having at least one significant 

15 descendant, the offspring of the root node may be evaluated 
for significance, wherein a significant offspring has a coef- 
ficient at least equal to the predetermined threshold. A 
significance value is input or output for each offspring of the 
root node, wherein the significance value indicates whether 

20 the offspring is significant 

Moreover, the method may include, for each significant 
offspring of the root node, adding the significant offspring to 
the LSP and outputring or inputting a sign of the coefficient 
of the significant offspring. For each insignificant offspring 

23 (an insignificant offspring of the root node has the coefficient 
less than the rxedetennined threshold), the method may 
include adding the insignificant offspring to the LTP. 
In another aspect the present invention includes a data 

M structure in a computer memory for use in encoding and 
decoding a subband decomposition of data points. The data 
structure comprises a list of insignificant sets of points 
("US"), a list of significant points ("LSP") and a list of 
insignificant points ("LIP"). 

35 As an enhancement, for each set of the LIS. the data 
structure may include a root node and a set type identifier. 
The set type identifier defines generations of descendants 
associated with the root node within the set of the LIS. 
wherein a first generation of descendants comprises off- 

40 spring of the root node. Moreover, the set type identifier may 
comprise one of a first type identifier and a second type 
identifier. A first type identifier designates that the set 
comprises all of the descendants of the root node. A second 
type identifier designates that the set comprises the descen- 

45 dants of the root node excluding the offspring of the root 
node. 

Yet another aspect of the present invention includes a 
computer program product comprising a computer useable 
medium having computer readable program code means 

so therein for use in encoding and decoding a subband decom- 
position of a data set Computer readable program code 
means are employed for causing the computer to affect the 
techniques disclosed herein. 
To summarize, the present invention has many advantages 

55 and features associated with it The coding scheme of the 
present invention used to process a subband decomposition 
of a data set provides a high level of compression while 
maintaining a high computational efficiency. The transmit- 
ted code (Le.. compressed data set) is completely embedded. 

60 so that a single file for. e.g.. an image at a given code rate, 
can be truncated at various points and decoded to give a 
series of reconstructed images at lower rates. Processing 
may even be run to completion resulting in a near lossless 
(limited by the wavelet filters) compression. Further, the 

65 encoder and decoder use syrnmetrical techniques such that 
computational complexity is equivalent during both encod- 
ing and decoding. Thus, the techniques of the present 
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invention advance the state of subband decomposition data The techniques disclosed herein are performed for mul- 

compression techniques. The coding results are either com- tiple quantization levels, with each successive quantization 

parable to. or surpass, previous results obtained through level defining higher numerical precision and thus a higher 

much more sophisticated and computationally complex quality image. Encoding and/or decoding may be terminated 

methods. 5 when the desired quality level has been reached. More 

specifically, according to the techniques of the present 

BRIEF DESCRIPTION OF THE DRAWINGS invention/the encoding process can be stopped at any 

The subject matter regarded as the present invention is compressed file size or let run until the compressed file is a 

particularly pointed out and distinctly claimed in the con- representation of a nearly lossless image. The only limit on 

eluding portion of the specification. The invention, however, to loss is determined by the precision of the wavelet transform 

both as to organization and method of practice, together with filters used during subband decomposition of the source 

further objects and advantages thereof, may best be under- image and during reconstruction of the destination image, 

stood by reference to the following detailed description of a For perfectly reversible compression, one skilled in the art 

preferred embodiment and the accompanying drawings in may use. e.g.. an integer multiresolution transform, such as 

which: 15 the S+P transform described in A. Said and W. A. Peariman. 

FIG. 1 is a schematic illustration of an image bitmap prior "Reversible Image Compression via Multiresolution Repre- 

to subband decomposition; sentation and Predictive Coding." Proc. SHE Conf. Visual 

FIG. 2 is a schematic illustration of the image bitmap of Ccmmuik^OLB and Image Processing '93. Proc. SPIE 

FIG. 1. subsequent to subband decomposition according to pp. 66M>74, Cambridge. Mass.. Nov 1993. which 

an embodiment of the present invention; 20 ^ excellent reversible compression results when used 

" ... ^_ . , . .... . with me techniques disclosed herein. 

FIG. 3 is an schematic illustration of parent-child rela- . ~ » ... r u . 

tionships within the image bitmap of FIG. 2 pursuant to one During the coding tecrmiqiies of the present invention 

embodiment of the present invention; cc ^ m °P*aUons are performed on tie points (lc., pixels) 

* ■ a . • - .. a. . £ within the subband decomposition. One operation that is 

FIG 4 is a flow diagram of *e coding method of an „ ^ fa a ^ test At ^ quantiMtion 

embodiment of the present invention; determinations of ^significance" are made for sets 

FIGS. 5-8 are more detailed flow diagrams of the coding comprising both individual points and collections of points, 

method of FIG. 4; and The "significance" test is defined as follows: 

FIG. 9 is a block diagram of a computer system used in 

implementing the principles of the present invention. 30 

max <ij)«T M {leJ}fc2"? 

DESCRIPTION OF THE PREFERRED 

EMBODIMENT In mc above test n is the current quantization level and T m 

t . . . ^ , . , . is a set of pixels or a single pixel If the comparison is 

An original image to rx compressed is defined bya set of n ^ ^ of mc QQdSdtuU of ^ mts of ^ sct 

pixel values p,, where ( M ) is me pixel coordinate (FIG. 1). 35 T „ , ess ^ ^ {2% and T is insignificant 

As a first step in me compression tecruuqu<* of the present c ^ nvcrscl d ±c ^mparison is positive, then at least one 

invention, a subband decomposition is performed on the Qf ^ CMmM of me sct x m ^ cqual t0 

image resulting in a tw^dir^nsional array ^hcr^ each M r) ^ j i% significant 

element c„ is called a transform coefficient ( coefficient ) at AccordiQ giy ¥ a significance function may be expressed as 

coordinate (ij). 40 foUows: 

In the example of FIG. 2, decomposition has been per- 
formed into 3 subbands. The designations of each subband. 
e.g., LH1. and subband decomposition methods will be 

apparent to one of ordinary skill in the art and are further S^T)~ < 

described in, e.g.. E H. Adehon, E Simoncellt and R. « 
Hingcrani, "Orthogonal Pyramid Transforms for Image 

Coding," Proc. SPIE. vol 845 — Visual Comm. and Image This function indicates the significance of a set T of coor- 
Ptoc. IL Cambridge, Mass., pp. 50-58, Oct 1987, and U.S. dinates as a "1" if significant and a "0" if not significant (i.e., 
Pat No. 5321.776, entitled "DATA COMPRESSION SYS- insignificant). To simplify the notation of single pixel sets, 
TEM INCLU DING SUCCESSIVE APPROXIMATION 50 S„({(ij)}) is written herein as S„(ij). 
QUANTIZER.* 1 by Shapiro, issued Jun. 14, 1994. both of it has been discovered that most of an image's energy is 
which are incorporated by reference herein in their entire- concentrated in the low frequency components, 
ties. Consequently, the variance decreases as we move from the 
The principles disclosed herein iroprove on the techniques highest to the lowest levels of the subband pyramid, 
by which the coefficients of the transformed image are 55 Furthermore, it has been observed that there is a spatial 
transmitted such that data compression is achieved and such self-similarity between subbands, and the coefficients are 
that efficient decompression is facilitated. Within the present expected to be better magnitude-ordered if we move down- 
invention, ordering data corresponding to the coefficients is ward in the pyramid following the same spatial orientation, 
not explicitly transmitted. Instead, the compression tech- For instance, large low-activity areas are expected to be 
nique is designed such that the execution path of the coder 60 identified in the highest levels of the pyramid, and they are 
is defined by the results of magnitude comparisons of replicated in the lower levels at the same spatial locations, 
coefficients at branching points within the execution path. According to the techniques of the present invention, a 
So. if the encoder and decoder have the same coding new tree structure, called a spatial orientation tree, naturally 
algorithm, then the decoder can duplicate the encoder* s defines the above discussed spatial relationship within the 
execution path if it receives the results of the magnitude 65 hierarchical subband pyramid. For example, FIG. 3 shows 
comparisons, and the ordering information can therefore be how a spatial orientation tree is defined in a pyramid that is 
recovered. constructed with recursive four-subband splitting. Each 
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node of the tree corresponds to a pixel, and is identified by from the LIS and partitioned into new subsets. The new 

the pixel coordinate. Its direct descendants (offspring) cor- subsets with more than one element are added back to the 

respond to the pixels of the same spatial orientation in the US. while the single-coordinate sets are added to the end of 

next finer level of the pyramid. The tree is defined such that the UP or to the end of the LSP. depending whether they are 

each node has either no offspring (i.e.. leaves) or four 5 insignificant or significant respectively, 

offspring, which always form a group of 2x2 adjacent pixels. As discussed above, pixels in the UP are evaluated prior 

In HG. 3. the arrows are oriented from each parent node to |° me ^aluaUon of sets of pxxels in the US. This ordering 

its four offspring. The pixels in the highest level of the l& established because information regarding a pixel is 

pyramid are the tree rc£*s and are also grouped in 2x2 ^™f<i immediately, thus immediately reducing di «*. 

, „ . . a i_ f: . . . rt tion in the received image. However, information regarding 

adjacent pixels. However their offspring branching rule is 10 ^ {$ ^ ^ te * ew tests for scts ud Ucls which 

different, and one of them (indicated by the star-*he upper do ^ hayc £ cffect on me receive 4 image, 

left corner point in each group) has no descendants. Each of Moreover, as discussed in further detail below, if a pixel is 

the other three in the group has a branching to a group of m0 ved to a list during set processing, information regarding 

four in a subband of the same orientation in the same leveL me move 4 pixel is immediately transmitted such that dis- 

Parts of the spatial orientation trees are used as partition- 15 tort ion in the received image is immediately reduced, 

ing subsets in the coding process. Accordingly, the following Throughout the techniques of the present invention, priority 

sets of coordinates are defined herein for use in connection ^ gj vcn to transmitting pixel information as quickly as 

with the techniques of the present invention: possible such that the received image may be quickly 

0(ij): set with the coordinates of all offspring (Le.. reconstructed. 

children) of node (ij); 20 The above summarized coding method is described in 

D(i j): coordinates of all descendants (Le.. children and greater detail below in conjunction with the flow diagrams 

following generations) of the node (ij); of FIGS. 5-8. A discussion of the initialization phase begins 

H: coordinates of all spatial orientation tree roots (Le.. reference to FIG. 5. An initial quantization level n is 

points in the highest pyramid level. e.g., 1X3); and M determined (121) as a function of: 

«=Lb& (mai^fcyBJ 

This (n) represents the number of bits of dynamic range that 
With reference to FIG. 3, except at the highest and lowest are required to represent the largest coefficient of the sub- 
pyramid levels, the relationship between levels comprises: 30 band decomposition of the source image. For example, if the 

largest value of any coefficient within the image is 234. then 

~.>^in- n/,. i<*.w^i^,M n would equal 7. The initial quantization level is then output 

0WH<* mWW+iZW+iMi)} ^ me jessed bit ^ (12 3). 

To perform the coding of the subband coefficients, three The lists used by the present invention are next initialised, 

ordered list are employed. They are the list of insignificant 35 Specifically, the LSP initially comprises the empty set (125). 

sets of pixels ("LET), the list of insignificant pixels ("UP"). The UP (127) includes all of the data points within the 

and the list of significant pixels ("LSP"). In these lists, each highest level LL subband H (e.g., LL3 of FIG. 2). All of the 

entry is identified by a coordinate (i j), which in the UP and data points within the highest LL subband are also used as 

LSP represents individual pixels, and in the LIS represents the initial root nodes of the LIS (129) and are designated as 

either the setD(Lj) or L(ij). To differentiate between D(ij) 40 set type A (Le.. DOj))- The points in the UP and the 

and L(i.j) in the LIS. a set type identifier is included with the corresponding roots in the US are initially listed in the same 

root node (i.j) coordinate pair and comprises a type A order. 

identifier if the set comprises D(i j), and a type B identifier Subsequent to initialization, each pixel within the UP is 

if the set comprises L(Lj). processed beginning with the first pixel (Lj) therein (FIG. 6, 

A high-level flow diagram of the coding technique of the 45 step 131). The significance (as discussed hereinabove) of the 

present invention is shown in FIG. 4. Prior to beginning pixel is output into the compressed data stream (133). If the 

coding, it is assumed that a subband decomposition of a pixel is significant (139). then it is moved off of the UP and 

subject image has already been performed as discussed to the LSP (135). Further, if significant, the sign of the 

hereinabove. During initialization (101). the lists (LIS. UP coefficient of the pixel (c, v ) is output into the compressed bit 

and LSP) used herein are created and the initial quantization 50 stream (137). Thereafter (and also if the pixel was not 

level is determined. Thereafter, a sorting phase is entered significant) a test is performed to determined if it was the last 

(106). Sorting includes the processing of the lists used herein pixel of the UP (143) and if not the next pixel in the UP is 

and the outputting of compressed data based upon such selected (141) and processing repeats (at step 133). 

processing. A refinement phase (107) is entered after sorting. After the above discussed processing of the LIP is 

during which data corresponding to pixels determined to be 55 completed, processing of the LIS begins (FIG. 6). An outside 

significant during sorting of earlier quantization levels is loop for processing each entry within the I .IS begins with the 

output A test is performed to determine if the last quanti- selection of the first set within the LIS as designated by its 

zation level has been processed (109) and If not. the next root node (i j) (145). The set type is then tested to determine 

quantization level is determined (111) and the method if it is a type A (147) and processing diverges based thereon, 

repeats staring with the sorting phase (105). After the last 60 If the set is of type A. meaning the set comprises D(ij). 

quantization level has been processed, data compression is the significance of D(ij) is tested, and its significance value 

completed (113). S M (D(ij)) is output into the compressed bit stream (149). If 

By way of summary, with regard to the sorting phase, the EKU) is not significant (151). then processing continues with 

pixels in the UP are tested, and those that are significant at a test to determine if all sets in the US have been processed 

the current quantization level are moved to the LSP. 65 (181. FIG. 7). and the selection of the next set in the US 

Similarly, sets are sequentially evaluated following the US ( 179) and looping (to step 147) if processing of all sets in the 

order, and when a set is found to be significant it is removed US has not completed. 
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To continue, if D(i j) « significant (151, FIG. 6), thco each 
pixel (k.1) within o(ij) (i.e., the offspring of (i.j)) is pro- 
cessed as defined by the loop which includes first (ki) 
selection (153), last (ki) processed test (167) and next (kJ) 
selection (163). Within this loop. S n (kJ) is output (155). If 5 
(kJ) is significant (157), then (ki) is added to the end of the 
LSP (159) and the sign of c u is output (161). If (ki) is not 
significant, then (ki) is added to the LIP (165). In either 
case, processing within the loop continues for each (ki) in 

0(ij). . l0 

After the processing of 0(ij) is completed, a test is 
performed to determined whether the set L(i,j) is not empty 
(169. FIG. 7). If it is not empty, then the set designated by 
root node (Lj) in the LIS is changed to a type B set (171) and 
processing continues with the type B processing discussed 
hereinbclow. If L(Lj) comprises the empty set, then the 15 
processing of each set within (he US continues (181). 

To recall, a test was performed to determine if the current 
set was of set type A (147). A corresponding test is per- 
formed in the flow diagram of FIG. 7, to determine if the 
current set comprises a type B set (173). If the set is not of 20 
type B. then the processing of each set within the LIS 
continues (181. 179). However, if the current set is of type 
B, then S„(L(ij)) is output (175). Thereafter, if L(ij) is 
significant (177). then each (ki) within CXM) is added as a 
root node to the end of the LIS as type A (183) and the 25 
current root node (i j) is removed from the LIS (185). (Note: 
each entry added to the end of the US (183) is evaluated 
before the current sorting pass ends) Processing of each set 
within LIS thereafter continues (181. 179). 

The refinement stage of the coding process is next per- 30 
formed (FIG. 8). During this stage, data is output for pixels 
in the LSP that were placed there during prior sorting passes 
(Le., from previous quantization levels). Refinement begins 
with the selection of a first pixel (ij) within the LSP that was 
not placed there during the immediately preceding sorting 35 
pass (187). The avoidance of those pixels placed on the LSP 
during the preceding sorting pass may be achieved by many 
programming techniques including, e.g., marking the end of 
the LSP prior to each sorting pass. 

To continue, the n* (n=quantization level) most signifi- 
cant bit of the coefficient of the selected pixel (c v ) is output 
(191). A test is then performed to determine if the last pixel 
within the LSP has been processed (193). and if it has not, 
men the next pixel in the LSP is selected (189) and the 
process repeats. 

The current quantization level is men decreased by one 
(195). If the ending quantization level has not yet been 
processed (197), then processing repeats beginning with the 
sorting phase (FIG. 5, step 131). Once processing of the 
ending quantization level has been completed, the process 
ends (199). The ending quantization level is predesigned to 
achieve a selected image quality/compression ratio. 

In the above discussion, the specific order of processing 
the lists, UP, LIS and then LSP. is chosen so that when 
processing terminates at any point prior to completion of a 
sorting pass at any quantization level, the coefficients just 
found to be significant at that level can be reconstructed 
approximately, because their significance data and signs 
have been outputted or inputted. In this way, the best 
reconstruction fidelity is obtained for any given compressed 
file size. If the order of processing the three lists is changed, 
the best reconstruction fidelity is obtained only at com- 
pressed file sizes corresponding to completion of processing 
all three lists UP, LIS and LSP for a given quantization level 
n. 

According to the techniques disclosed herein, branching 
conditions based on the significance data Sn that are calcu- 
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lated for c*j are output into the compressed bit stream by the 
encoder. A decoding method is created by duplicating the 
encoder's execution path for sorting significant coefficients, 
but replacing each "output" with an "input" Whenever the 
decoder inputs data, its three control lists (LIS, UP. and 
LSP) are identical to the ones used by the encoder at the 
moment it outputs that data. Thus, the decoder recovers the 
ordering from the execution path. The coding scheme of the 
present invention therefore results in an encoder and decoder 
that are symmetrical and have the same computational 
complexity. 

In more specific regard to the decoder, an additional task 
performed thereby is to update the reconstructed image. For 
the value of n. when a coordinate is moved to the LSP, it is 
known that 2 n <=)c(i,j)i<2 n+i . So. the decoder uses that 
information, plus the sign bit that is input just after the 
insertion in the LSP. to set £^+-1.5x2". Similarly, during 
the refinement pass, the decoder adds or subtracts 2"~ l to t tJ 
when it inputs the bits of the binary representation of Ic J. In 
this manner the distortion gradually decreases during both 
the sorting and the refinement passes. 

As with any other coding method, the efficiency of the 
encoder disclosed herein can be improved by entropy- 
coding its output, but at the expense of a larger encoding/ 
decoding time. Practical experiments have shown that some 
improvements in performance are obtained by entropy- 
coding the coefficient signs and/or the bits put out during the 
refinement pass. 

In another embodiment of the present invention, coding 
efficiency is enhanced by keeping groups of 2x2 coordinates 
together in the lists (US, UP and LSP) and coding their 
significance values as a single symbol. In this group of four 
pixels, each one is significant if its coefficient is greater than 
or equal to the threshold. 2". Since the decoder only needs 
to know the transition from insignificant to significant (the 
inverse is impossible), the amount of information that needs 
to be coded changes according to the number m of insig- 
nificant pixels in that group, and in each case it can be 
conveyed by an entropy-coding alphabet with 2 m symbols. 
With arithmetic coding it is straightforward to use several 
adaptive models, each with T 1 symbols. me{ 1, 2. 3, 4}. to 
code the information in a group of 4 pixels. 

By coding the significance information together, the aver- 
age bit rate corresponds to a m** order entropy. At the same 
time, by using different models for the different number of 
insignificant pixels, each adaptive model contains probabili- 
ties conditioned to the fact that a certain number of adjacent 
pixels are significant or insignificant. Accordingly, the 
dependence between magnitudes of adjacent pixels is fully 
, exploited. This scheme is also useable to code the signifi- 
cance of trees rooted in groups of 2x2 pixels. 

A particular data structure is useful in connection with 
representing groups of 2x2 pixels together In the lists of the 
present invention. The data structure of each tree node (Le.. 
. group of 2x2 pixels) is represented by the following "C 
programming code: 



{ 

loos state; 
Trce_Nodc ♦ next; 



The pair (x.y) contains the image coordinate of the 
upper-left pixel of the group. The pair (x,y) therefore rep- 
resents the coordinates of an upper-left pixel of the group of 
four pixels. The pixels in the group are numbered as follows: 
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Thus, to obtain the coordinates of a pixel in the group, one 
of four pairs of values is added to (x,y). The four pairs 
comprise: 

(0,0)— pixel 0 

(1.0>-pixel 1 

(0.1)— pixel 2 

(U>-pixel 3 

The variable 'state' contains significance data related to 
the set of four pixels and is used in the processing described 
herein. Specifically, 'state* contains significance data for the 
four pixels and for the four groups of descendants for the 
four pixels. 

The even-numbered bits of "state* indicate if the indi- 
vidual pixels of the group are significant, and the odd- 
numbered pixels indicate if the descendant sets are signifi- 
cant Thus, if Pk is the significance value of pixel k (in the 
2x2 block), and Sk Is the significance value for the set 
descending from pixel k (the significance value of a set of 
four pixels is calculated using the arithmetic mean of the 
coefficients of the four pixels), then the 8 least significant 
bits of 'state' comprise: 

S3 P3 S2 P2 SI PI SO P0 
For example, if the 8 least significant bits of 'state' comprise 
"0 0 1 0 0 1 0 0". then only the descendant set of pixel 2 and 
individual pixel 1 are significant The other pixels and 
descendant sets are insignificant 

The above discussed 'state' variable is easily tested for 
conditions. For example, one. test comprises the following 
"C 1 programming code: 

if ((group-»state & 0xAA=0) then . . . 
In one statement this test determines if all sets of descen- 
dants of the 2x2 group are insignificant ('group* is a pointer 
to a one tree node). According to the set decomposition 
scheme, if the result of this test is 'true 1 , it means that the 
LIS entry is of type *A*"; otherwise it is of type *B\ 

The pointer 'next* in the data structure is used to create a 
dynamically allocated linked list. The entries are created 
when needed, and disposed of when not needed. 
Specifically, entries are created whenever a new set (tree) is 
added to the LIS and are deleted when. e-g., all bits within 
* state' are set to one (Le.. all pixels in the set and their 
descendants are significant). 

Although the techniques of the present invention have 
been described herein with respect to image processing, 
other forms of data may be processed. Any data set that may 
be transformed through subband decomposition may subse- 
quently have the transform coefficients coded fox transmis- 
sion and/or storage using the disclosed techniques. Far 
example, a digitized audio segment may be decomposed into 
frequency subbands and encoded as described herein. 
Furthermore, the coding techniques of the present invention 
may be applied to various types of subband decompositions 
with their associated filter, and to other linkages of pixel 
coefficients within these subbands. 

The hardware elements of a design system used to imple- 
ment the techniques of the present invention are shown in 
FIG. 9. A central processing unit ("CPIT) 211 provides main 
processing functionality. A memory 213 is coupled to CPU 
211 for providing operational storage of programs and data. 
Memory 213 may comprise, for example, random access 
memory CT^AM") or read only memory ("ROM"). Non- 
volatile storage of. for example, data files and programs is 
provided by a storage 215 that may comprise, for example, 
disk storage. Both memory 213 and storage 215 comprise a 
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computer useable medium that may store computer program 
products in the form of computer readable program code. 
User input and output is provided by an input/output ("I/O") 
facility 217. I/O facility 217 may include, for example, a 

5 graphical display, a mouse and/or a graphics tablet As an 
example, the design system of FIG. 9 may comprise an 
International Business Machines RISC System/6000 com- 
puter executing an AIX operating system. 
The present invention has many advantages and features 

l0 associated with it The coding scheme of the present inven- 
tion used to process a subband decomposition of a data set 
provides a high level of compression while maintaining a 
high computational efficiency. The transmitted code (Le.. 
compressed data set) is completely embedded, so that a 

l5 single file for. e.g., an image at a given code rate can be 
truncated at various points and decoded to give a series of 
reconstructed images at lower rates. Processing may even be 
run to completion resulting in a near lossless (limited by the 
wavelet filters) compression. Further, the encoder and 

^ decoder use symmetrical techniques such that computational 
complexity is equivalent during both encoding and decod- 
ing. Thus, the techniques of the present invention advance 
the state of subband decomposition data compression tech- 
niques. The coding results are either comparable to. or 

25 surpass, previous results obtained through much more 
sophisticated and computationally complex methods. 

The individual programming steps required to implement 
the techniques of the present invention will be apparent to 
one of ordinary skill in the art in view of the discussion 

30 presented herein. 

While the invention has been described in detail herein, in 
accordance with certain preferred embodiments thereof, 
many modifications and changes therein may be affected by 
those skilled in the art Accordingly, it is intended by the 

J5 following claims to cover all such modifications and 
changes as fall within the true spirit and scope of the 
invention 
We claim: 

1. A method for use in encoding and decoding a subband 
w decomposition of a data set. said method comprising the 
steps of: 

(a) creating a list (LIS) consisting of insignificant sets of 
points, each set of said LIS being designated by a root 
node within said subband decomposition and having a 

i5 corresponding tree structure of points within said sub- 
band decomposition, said corresponding tree structure 
of points being organized only as descendants and 
offspring of said root node and not including the root 
node, wherein a first generation of said descendants 

w comprise said offspring; 

(b) evaluating said descendants of said root node of each 
set of said LIS for significance, wherein a significant 
descendant of said descendants of said root node has a 
coefficient at least equal to a predetermined threshold; 

55 (c) for each root node of said LIS having at least one 
significant descendant evaluating descendants of said 
offspring of said root node for significance, wherein a 
significant descendant of said offspring of said root 
node has a coefficient at least equal to said predeter- 
60 mined threshold; and 

(d) if said root node has at least one significant descendant 
of offspring, then adding additional sets corresponding 
to each of said offspring of said root node to said LIS 
as a root node thereof. 
65 2. The method of claim 1. wherein prior to said step (b). 
said method includes creating a list of significant points 
(LSP), said LSP initially comprising an empty set. and 
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creating and keeping a list (UP) consisting of individual 
insignificant points, said LIP initially comprising points 
from within a highest designated subband of said subband 
decomposition. 

3. The method of claim 2. wherein prior to said step (b), $ 
said method includes one of outputting and inputting a 
significance value for each point within said LTP. said 
significance value indicating whether a coefficient of said 
point within said LIP is at least equal to said predetermined 
threshold. 10 

4. The method of claim 3, wherein for each point in the 
f TP after said one of outputting and inputting the signifi- 
cance value for (he point within the LIP. if the coefficient of 
the point is at least equal to said predetermined threshold 
moving the point from the LIP to the LSP and one of 
outputting and inputting a sign of the coefficient of the point 13 

5. The method of claim 2. wherein prior to said step (c) 
for each root node of said US having at least one significant 
descendant, evaluating said offspring of said root node for 
significance, wherein a significant offspring has a coefficient 

at least equal to said predetermined threshold, and one of 20 
immediately outputting and inputting a significance value 
for each offspring of said root node, said significance value 
indicating whether said offspring is significant. 

6. The method of claim 5, further comprising, for each 
significant offspring of said root node, adding said signifi- 2 5 
cant offspring to said LSP and one of outputting and 
inputting a sign of the coefficient of said significant off- 
spring. 

7. The method of claim 5. wherein an insignificant off- 
spring of said root node has said coefficient less than said ^ 
predetermined threshold, and wherein said method further 
comprises, for each insignificant offspring of said root node, 
adding said insignificant offspring to said UP. 

8. The method of claim 1, wherein each set of said US has 
a set type identifier comprising one of a type A and a type 

B, said type A designating said set as all descendants of the 35 
root node of said set said type B designating said set as all 
of the descendants of the root node of said set excluding the 
offspring of said root node, and wherein said step (a) 
includes designating each set of said LIS as said type A. 

9. The method of claim 8. wherein said step (d) comprises. 40 
if said root node has at least one significant descendant of 
offspring, adding each offspring of said root node to said LIS 

as a root node thereof, said offspring having said type A set 
type identifier corresponding thereto within said LIS. 

10. The method of claim 9. wherein said step (d) further 45 
comprises, if said root node has at least one significant 
descendant of offspring, removing said root node from said 
US. 



11. The method of claim 8, wherein said step (c) 
comprises, for each root node of said US having at least one 
significant descendant of offspring, changing said set type 
identifier of the set comprising said root node to said type B. 

12. The method of daim 11. wherein said step (d) 
comprises, for each set within said US comprising said type 
B. outputting a significance indicator corresponding to said 
set said significance indicator indicating whether a coeffi- 
cient of any point within said set is at least equal to said 
predetermined threshold. 

13. A computer program comprising a computer useable 
medium having computer readable program code therein for 
use in encoding and decoding a subband decomposition of 
a data set said computer readable program code in said 
computer program comprising: 

first computer readable program code for causing a com- 
puter to affect creating a list (LIS) consisting of insig- 
nificant sets of points, each set of said LIS being 
designate by a root node within said subband decom- 
position and having a corresponding tree structure of 
points within said subband decomposition, said corre- 
sponding tree structure being organized only as descen- 
dants and offspring of said root node and not including 
said root node, wherein a first generally of said descen- 
dants comprise said offspring; 

second computer readable program code for causing a 
computer to affect evaluating said descendants of said 
root node of each set of said US for significance, 
wherein a significant descendent of said descendants of 
said root node has a coefficient at least equal to said 
predetermined threshold; 

third computer readable program code for causing a 
computer to affect far each root node of said US having 
at least one significant descendant evaluating descen- 
dants of said offspring of said root node for 
significance, wherein a significant descendant of said 
offspring of said root node has a coefficient at least 
equal to said predetermined threshold; and 

fourth computer readable program code for causing a 
computer to affect adding additional sets corresponding 
to each of said offspring of said root node to said LIS 
as a root node thereof when said root node has at least 
one significant descendant of offspring. 
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